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Estimating  a  Distribution  Function 
When  New  is  Better  Than  Used 

Francisco  J.  Samaniego  and  Russell  A.  Boyles 
University  of  California,  Davis 

Abstract 

Let  F  be  a  distribution  function  on  (0,®),  and  let  S  *  1-F  be  its 
corresponding  survival  function,  F  is  ^aid  to  be  New  Better  than  Used 
(NBU)  if  S(x)S(y)  >  S  (x  +  y)  for  all  x  and  y  .  Let  Sn(x)  be  the  empirical 
survival  function  based  on  a  random  sample  of  size  n  from  an  NBU  distri¬ 
bution  function  F  .  This  paper  is  dedicated  to  the  study  of  the  estimator 

A 

Sn(x)  defined  as  sup{S^(x  +  y)/S^(y) } ,  where  the  supremum  is  taken  over 

A 

all  y  for  which  S  (y)  >  0.  It  is  shown  that  S  is  an  NBU  survival  curve, 

7  n'77  n 

A 

and  that  it  is  relatively  easy  to  compute.  While  S  is  not  consistent  in 

A 

general,  it  is  shown  that  is  strongly  uniformly  consistent  for  S  when 
the  underlying  distribution  has  compact  support  (for  example,  when  sampling 
is  subject  to  type  I  censoring).  Moreover,  in  such  problems,  the  rate  of 

A 

convergence  of  is  shown  to  be  optimal. 

1,  Introduction  and  Sinwnary.  A  variety  of  nonparametric  classes  of  life 
distributions  have  been  introduced  into  the  literature  of  statistical 
reliability  theory  over  the  last  decade  and  a  half.  The  appeal  of  such 
classes  is  that  they  directly  model  a  qualitative  characteristic  of  com¬ 
ponents  or  systems  without  additional  (and  often  unnatural)  constraints. 

The  difficulty  and  the  challenge  that  such  nonparametric  models  pose  is 
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that  inference  results  tend  to  be  more  difficult  to  develop.  This  paper 
is  dedicated  to  the  estimation  of  a  particular  nonparametr ic  class,  the 
class  of  distributions  with  the  "New  Better  than  Used"  (NBU)  property. 

Let  F  be  the  distribution  of  a  nonnegative  random  variable  X  .  Let 
S(x)  =  l-F(x)  represent  the  corresponding  survival  function.  F  is  said 
to  be  NBU  if  the  inequality 


S  (x)S  (y)  >  S(x  +  y) 


(1.1) 


obtains  for  all  nonnegative  x  and  y  .  From  a  modeling  viewpoint,  the 
inequality  (1.1)  simply  formalizes  the  notion  that  the  residual  lifetime 
of  a  used  item  tends  to  be  shorter  than  the  lifetime  of  a  new  item.  A 
good  deal  is  known  about  the  class  of  NBU  distributions.  Much  of  Chapter  6 
in  Barlow  and  Proschan  (1975)  is  dedicated  to  their  study.  In  particular, 
it  is  well  known  that  the  class  contains  all  distributions  whose  failure 
rate  is  increasing  on  the  average  (IFRA)  and  the  still  smaller  class  of 
distributions  with  increasing  failure  rate  (IFR).  By  far,  the  major  portion 
of  the  literature  on  NBU  distributions  deals  with  their  stochastic  proper¬ 
ties  rather  than  with  inference  questions.  An  inference  paper  worth  noting 
is  that  of  Hollander  and  Proschan  (1972)  which  studies  the  problem  of 
testing  exponent iality  against  NBU  alternatives. 

'-^The  problem  we  study  in  this  paper  is  the  estimation  of  the  distribu¬ 
tion  function  F  under  the  assumption  that  F  belongs  to  the  class  of  NBU 
distributions.  Without  the  NBU  restriction,  the  empirical  distribution 
function  ^converges  to  F  in  several  senses  and  at  the  best  possible  rate. 


However,  ^need  not  be^NBU,  and,  in  fact,  it  is  not  difficult  to  show  that 
P(F>n  is  NBU)  0  when  sampling  from  some  NBU  distributions  (for  example, 
the  exponential  distribution).  Our  goal  here  is  to  construct  a  sequence 
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of  NBU  distributions  which  achieve  the  same  asymptotic  optimality 
as  the  sequence  *  pa¬ 
eons  is  tent  estimators  of  IFR  distributions  were  obtained  by  Marshall 

% 

and  Proschan  (1965)  and,  in  a  somewhat  different  context,  by  Crow  and 
Shimi  (1972).  Consistent  estimators  of  IFRA  distributions  are  given  in 
Barlow  et  al.  (1972)  as  a  special  case  of  their  treatment  of  star-ordered 
distributions.  All  of  these  solutions  make  use  of  the  methodology  of 
isotonic  regression.  Such  an  approach  is  not  useful  for  estimating  NBU 
distributions  since  the  natural  monotonicity  present  in  these  smaller 
classes  (IFR,  IFRA)  is  absent  in  the  general  NBU  class.  Hence,  a  sub¬ 
stantially  different  approach  is  taken  in  the  current  study. 

Let  X^,...,Xn  be  a  sample  of  size  n  from  a  distribution  F  ,  assumed 
to  be  NBU.  We  propose  to  study  here  the  properties  of  the  function 


-  S  (x  +  y) 

s„<*>  ■  "7  (t-2) 

as  an  estimator  of  the  survival  function  S(x),  where  is  the  empirical 
survival  function,  and  where  the  supremum  is  taken  over  nonnegative  y  for 

A 

which  S  (y)  >  0.  The  form  of  S  is  motivated  from  the  following  considera- 
n  n 

tions:  If  S  were  an  NBU  survival  function,  then  the  inequality 


S 

n 


(X)  > 


Sn(x  +  y) 

"VTT 


(1.3) 


would  be  satisfied  for  all  appropriate  x  and  y  .  If  Inequality  (1.3)  Is 
violated  for  some  x  and  y  ,  then  a  new  function  Is  constructed  In  an 
attempt  to  rectify  this  violation.  For  each  fixed  x  ,  the  new  function 
seeks  to  accommodate  all  violations  of  (1.3)  by  taking  a  supremum  over  all 
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violations.  It  is  not  clear  at  first  sight  that  what  results  is  a  legiti¬ 
mate  survival  function.  Our  initial  hope  was  that  several  iterations  of 
the  transformation  given  in  (1.2)  would  result  in  an  NBU  survival  function 
that  would  serve  as  an  estimator.  We  have  been  able  to  show,  however, 

A 

that  the  S^(x)  itself  is  an  NBU  survival  function,  that  it  is  strongly 
uniformly  consistent  in  a  class  of  problems  of  substantial  practical  im¬ 
portance  (the  sampling  from  an  NBU  distribution  under  type  I  censoring), 
and  that,  in  such  problems,  it  converges  to  the  underlying  NBU  survival 

A 

function  S (x)  at  an  optimal  rate.  The  general  properties  of  S^(x)  are 
given  in  Section  2,  consistency  is  studied  in  Section  3,  and  rate  results 
are  given  in  Section  4.  In  the  final  section,  we  discuss  some  remaining 
open  problems  and  make  some  concluding  general  remarks. 


2.  Properties  of  S  (x) .  The  properties  we  wish  to  establish  for  S  (x) 
-  ti  n 

follow  from  general  properties  of  the  transformation  T  :  S  -»  T  o  S  defined 
by 


To  S(x) 


sup 

{y  >  o|s  (y)  >  0} 


Slx±£l 
s(y)  ' 


(2.1) 


For  simplicity  of  notation,  we  will  usually  delete  the  index  over  which 
suprema  are  taken;  unless  otherwise  stated,  the  index  should  be  understood 
to  be  the  set  of  nonnegative  y  for  which  the  denominator  of  the  fractional 
expression  is  positive. 

Theorem  2.1.  Let  F  be  distribution  function  on  (0,®),  and  let 

S(x)  *  l-F(x)  be  the  corresponding  survival  function.  Then,  the  function 

T°  S(x)  defined  by  (2.1)  has  the  following  properties: 


(a)  To  S(x)  is  well  defined,  and  0  <  To  S(x)  <1  ¥  x,  with  To  S(0)  ■  1. 


(b)  To  S(x)  is  nonincreasing. 

(c)  To  S(x)  is  right  continuous. 

(d)  If  S(x)  =  0  for  x  >  M,  then  To  S(x)  =  0  for  x  >  M  . 

(e)  For  all  nonnegative  x  and  y  ,[To  S(xS[To  S(y)]>  To  S(x+y)  . 

(f)  To  S (x)  >  S(x)  for  all  x  . 

(g)  If  S  is  NBU,  then  To  S  «  S  . 

Proof. 

(a)  By  hypothesis,  S(0)  *  1.  Thus  the  set  {y  >  0|s(y)  >  0}  is  non¬ 
empty,  and  To  S(x)  is  well  defined  V  x.  Moreover,  To  S(x)  is  the  supremum 
of  a  set  of  fractions,  each  of  which  is  nonnegative  and  less  than  or  equal 
to  one .  Thus , 


0  <  To  S(x)  <  1 


Also, 


1  >  To  S (0)  -  sup  >  1^1  =  1 


(b)  Suppose  u  <  v.  Then  for  all  y  , 


S(u  +  y)  >  S(v  +  y), 


This  implies  that 


T°  s<“>  ■  “P  ^f1 1  *»P 
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(c)  Let  e  >  0  be  arbitrary,  and  let  x  be  fixed  but  arbitrary.  By 
the  definition  of  To  S(x),  we  can  find  y*  such  that 


s(*.+  y  ).  >  Xo  S(x)  . 
S(y*) 


c . 


Then,  for  any  6  >  0 ,  we  have  by  part  (b) 

To  S (x)  >  To  S(x+) 

>  To  S(x+  6) 

S  (x  +  6  +  y*) 

“  S(y*) 

where  T°  S(x+)  =  lim  T°  S(z).  Since  S  is  right  continuous,  we  have 
z-»  x+ 


SQci-6  +  y  )  _  S(x  +  y*) 


s  (y*) 


S(y*) 


as  6  -•  0.  Thus 


T °  S (x)  >  To  S(x+) 

S(x  +  y*) 
"  S(y*) 


>  T«  S (x)  -  e 


Since  e  is  arbitrary,  we  have  To  S(x+)  *  To  S(x) 


(d)  Suppose  S(x)  -  0.  Then  by  (a) ,  S(x  + y)  »  0  V  y  >  0,  and  thus 


T.  S(x)  -  .up 


0 


since  the  fraction  g is  well  defined  for  y  sufficiently  small. 


(e)  [To  S(x)][ToS(y)]  =  sup  sup 


S(x  +  y  +  z)  S(y  +  z) 

^  szp  s<7+.) 


>  SUD  Sjxjiy  +  z)  .  SJj_±zl 

~  zp  s(y  +  z)  s(z) 


To  S(x  +  y) 


(f)  S(0)  *  1  by  hypothesis.  Thus, 


S(x) 


§1x1 

S(0) 

S(x  +  y) 

-T  S(7) 

<  To  S(x)  . 


(g)  If  S  is  NBU,  then  for  each  fixed  x  and  all  appropriate  y  , 


S(x)  > 


S(x-t-y) 

S(y)  * 


Hence 


S(x)  >  sup 

y 


S(x  +  y) 

S(y) 


*  To  S(x) . 


This  inequality,  together  with  part  (f)  proves  the  claim.  This  completes 
the  proof  of  the  theorem.  ■ 


A 
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Remarks  .  (1)  While  Theorem  2.1  does  not  deal  with  distributions  F  having 

a  point  mass  at  0 ,  such  distributions  cause  no  essential  difficulty.  If 

a  distribution  is  degenerate  at  zero,  then  T  o  S(x)  is  undefined;  we  can 

deal  with  this  situation  by  simply  defining  T°  S(x)  s  0  when  S  s  0  on 

[0,®).  With  this  understanding.  To  S  is  well  defined  for  any  distribution 

on  [0,®),  and  all  properties  in  Theorem  2.1  apply  to  the  extension  of  To  S  , 

with  the  exception  of  the  equation  To  S(0)  =  1 .  If  F  has  a  point  mass 

at  0  ,  then  the  empirical  c.d.f.  is  degenerate  at  zero  with  positive 

probability,  and  the  above  extension  of  the  transformation  T  is  necessary. 

However,  when  the  true  distribution  function  F  is  NBU,  we  must  have 

2 

S(0)=0  or  1,  since  S(0)  >  S(0).  Thus,  F  will  either  be  degenerate  at 

zero  or  give  no  mass  to  zero,  and  these  properties  are  inherited  by  F  . 

(2)  In  general,  To  S  need  not  be  a  survival  function,  that  is,  it  need  not 
be  true  that  To  S(x)  0  as  x  ®  ,  For  example,  if  F  is  the  Pareto 
distribution  with  survival  function 

S(x)  -  “  for  x  >  1  , 

it  is  easy  to  see  that  To  S(x)  s  1  ♦  However,  part  (d)  of  Theorem  2.1 
shows  this,  cannot  happen  when  F  has  compact  support. 

Now,  let  S  be  the  emprirical  survival  function.  Parts  (a) -(d)  of 

A 

Theorem  2.1  prove  that  Sn(x)  *  To  S^Cx)  Is  a  survival  function.  Moreover, 

A 

S  (x)  is  NBU.  Since  NBU  distributions  are  precisely  the  fixed  points  of 

A 

the  transformation  T  ,  Sn(x)  is  the  empirical  survival  function  whenever 
S  (x)  is  itself  NBU. 

A 

We  close  this  section  with  some  remarks  on  the  computation  of  Sn(x). 

For  a  given  S  ,  the  computation  of  To  S(x)  can  involve  uncountably  many 
maximization  problems,  each  of  which  can  be  difficult  analytically.  It 
is  therefore  obvious  that  for  some  survival  curves,  the  computation  of 
T6  S(x)  is  intractable.  Fortunately,  such  is  not  the  case  for  the 
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estimator  S  (x)  .  The  following  result  reduces  the  computation  of  S  (x) 
n  n 

to  a  simple  programming  problem. 


Theorem  2.2.  Let  x.  <  x0  <  ...  <  x  be  the  order  statistics  from  a 

i  —  z  —  n 

random  sample  of  size  n  from  the  distribution  F  on  (0,®).  Let  Sn(x) 

A 

be  the  empirical  survival  function,  and  let  S^(x)  be  as  in  (1.2).  Then 

a 

Sn(x)  has  the  following  characteristics: 


(a)  For  any  x  >  0, 


S 

n 


(x) 


sup 

i 


W 


(b)  S^(x)  *-s  a  steP  function,  and  if  S^(x)  has  a  jump  at  x  ,  then 

X  ■  X  -  X  for  some  r  and  s  ,  where  0  <  s  <  r  <  n  ,  with  defined  as 
r  s  —  —  0 

zero. 

Proof. 

(a)  Since  is  a  step  function,  the  ratio 

sn(x+y) 

S„W 

will  change  values  only  when  y  **  x^  for  some  i  or  when  x  +  y  =  for 
some  i  .  Now  suppose  the  latter  equation  obtains  for  some  y  that  is  not 
an  order  statistic.  Then,  for  some  positive  e  ,  we  have 

Sn(x  +  y-c)  Sn(x  +  y) 
sn(y  -  «)  >  Sn(y) 


10 


since,  for  e  sufficiently  small. 


s„(y  -  O  -  s„(y> 


while 

Sn(x  +  y  -e)  >  Sn(x  +  y). 

* 

This  shows  that  for  the  purpose  of  defining  S^(x),  we  need  only  consider 
ratios  of  the  form 


w 


(b)  We  show  that  unless  x  =  x  -  x  for  some  r,s  such  that 
v  y  r  s 

A  A 

0  <  s  <  r  <  n,  there  exists  a  positive  number  e  for  which  S  (x)  =  S  (x  +  e). 
—  —  n  n 

Suppose  x  €  (0,®)  is  such  that  x  ^  x  -  x  for  0  <  s  <  r  <  n  .  From 
part  (a),  we  know  that 


sn(x) 


sup 

i 


W 


Since  no  x  +  x^  is  equal  to  an  order  statistic,  it  is  possible  to  find 
c  >  0  such  that 


But  then 


S  (x+e+x.)  ■  S  (x  +  x.) 
nN  i'  nN  i 


S 

n 


(x  +  c  +xi) 

w" 


V1”!1 

W 


V  i 


so  that 


S „(*  +  «)  *  S  (x). 
n  n 
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a 


Thus,  x  is  not  a  Jump  point  of  Sn(x).  This  argument  shows,  in  fact,  that 

Sn  is  ®  step  function  whose  jump  points  may  only  occur  at  numbers  in  the 

finite  set  (x  €  (0,<»)|x  =  x  -x  ,  0  <  s  <  r  <  n}.  ■ 

r  s 

A 

The  result  above  shows  that  the  computation  of  involves  checking 
at  most  (  £  )  points  for  possible  jumps.  At  each  potential  jump  point  x  , 
the  comparison  of  the  numbers 


Sn<»  +  *1> 

W 


reveals  the  value  of  S^.  Writing  a  program  for  computing  is  thus 
entirely  elementary.  The  computation  is  in  fact  even  simpler  than  indi¬ 
cated,  since  a  fair  number  of  potential  jump  points  may  be  eliminated  from 
consideration  by  arguments  exemplified  in  the  following  result. 


Theorem  2.3,  Let  *  0,  and  let  x.  <  x*  <  . . .  <  x  be  the  order  statistics 
*  u  1  —  Z  “  —  n 

from  a  random  sample  of  size  n  from  a  distribution  F  on  (0,®).  Then 


Sn(x) 


¥  x  <  max(x.  -  x  .  )  . 
i  1  1“ 1 


Proof:  If  x  <  x,  -x,  „  for  some  1  .  then 

—  j  j-i  J 


-  S  (x  +  »,  ,) 

Sn(x>  >  V1  ■  1 

n  v'j-i' 


so  that 
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Besides  being  relevant  to  computation,  the  result  above  is  useful  in  our 

* 

discussion  of  the  consistency  of  Sr. 

3.  The  Question  of  Consistency,  In  spite  of  its  appealing  stochastic 

A 

and  computational  properties,  the  transformation  Sn(x)  =  To  S^(x)  does  not 
provide  the  complete  answer  to  the  problem  of  estimating  an  NBU  distri*  - 

A 

tion.  Indeed,  is  not  in  general  a  consistent  estimator  of  S  .  Suppose, 

—\x 

for  example,  that  S (x)  *  e  ,  the  survival  function  of  the  exponential 
distribution.  The  exponential  is  of  course  a  boundary  case  in  the  family 
of  NBU  distributions,  being  the  unique  continuous  distribution  for  which 
S(x)S(y)  «  S(x  +  y).  One  can  demonstrate  the  inconsistency  of  Sn(x)  when 
sampling  from  the  exponential  distribution  as  follows.  Fix  x  .  Since 

A 

(S^(x)}  are  bounded  random  variables,  it  suffices  to  show  that,  for  all  n, 

E  S  (x)  >  M  >  e"Xx  . 

Now  it  is  well  known  that  the  spacing  between  the  two  largest  order 
statistics  from  an  exponential  sample  has  the  same  distribution  as  the 
original  observables;  that  is, 

Xn  -  Vl~ExP<X)' 


If  x  <  X  -  X  , 
n  n-1 

tf  x  >  X  -  X  , 
—  n  n-1 


Nov  define 


By  Theorem  2.3  and  part  (f)  of  Theorem  2,1,  we  have 


Thus , 


S  (x)  >  R  (x)  . 
n  7  —  n 


ES  (x)  >  ER  (x) 
n  '  —  n  7 

>  1  •  P(X  -  X  ,  >  x) 

-  n  n-1  7 

+  ES  (x)  •  P(X  -X  t  <  x) 
n  n  n-1  — 


p  +  (l-p)e 


-\x 


>  e_Xx, 


where  p  *  P(X  -X  -  >  x)  >  0. 
n  n-1 

It  is  easy  to  pinpoint  the  reason  for  the  inconsistency  demonstrated 

above.  It  is  clear  that  the  tail  behavior  of  S  plays  a  crucial  role  in 

n 

A 

the  asymptotic  behavior  of  S^.  This  leads  us  to  investigate  the  con** 

A 

sistency  of  in  problems  in  which  the  tail  behavior  of  is  controlled. 
We  establish  in  the  following  two  theorems  the  strong  uniform  consistency 

A 

of  S  when  sampling  from  an  NBU  distribution  with  compact  support, 
n 

Theorem  3.1.  Let  F  be  an  NBU  distribution  on  (0,®),  and  let  S  *  1-F. 
Suppose  the  constant  T  •  lnf{M|F(M)  »  1}  is  well  defined  and  finite.  Then 
for  all  x  , 

Sn(x)  -  S(x) 


with  probability  one 


Proof .  By  the  Glivenko-Cantelli  theorem,  there  exists  a  null  set  71  such 


that  You  €  Q/??, 


supjF  (z)  -  F(z)|  -  0. 


Our  notation  suppresses  the  fact  that  the  sequences  we  will  consider  depend 

*  A 

on  a)  .  Since  Sn(0)  *  1  and  Sn<T)  ■  0  for  all  n,  we  need  only  establish  con¬ 
vergence  of  Sn(x)  for  x  €  (0,T).  Let  such  an  x  be  fixed.  For  any 
u)  €  Cl/71  ,  we  have 


S  (x  +  y) 

T  s„<»>  -  s"<,) 


which  implies  that 


lira  S  (x)  >  lira  S  (x) 
-  n  “  „  n 


=  S(x). 


In  order  to  obtain  an  upper  bound  for  lim  S^(x) ,  we  note  that  V  y  for 


which  S(y)  >  0, 


Sn(x  +  y)  S(x  +  y) 

n  - •  S(y)  *  S(y) 
n-»»  n 


<  S(x) 


since  F  is  NBU. 

Ue  wish  to  show  that  for  any  c  >  0 , 


_  Sn(x  +  y) 

lim  sup  ■■  7ZV 


<  S (x)  +  c . 


(3-D 


Suppose  (3.1)  fails  for  some  fixed  Then  there  exists  a  sequence 

fy  1  such  that 

1  v 


sn  (x  +  yn  ) 

ni  ni 

Sn  <*„  ) 

"i  "l 


>  S(x)  +  * 


V  i. 


(3.2) 


The  sequence  [y  }  is  bounded;  indeed 
ni 

without  loss  of  generality,  that 


y  <  T-x  Vi.  We  will  assume, 
ni  " 


for  otherwise,  we  could  extract  a  convergent  subsequence  satisfying  (3.2). 

We  now  consider  two  cases:  either  [y  3  contains  a  subsequence  converging 

ni 

to  y*  from  above,  or  it  contains  a  subsequence  converging  to  y*  from  below. 

Again,  without  loss  of  generality,  we  will  assume  first  that  y  increases 

ni 

to  y  and  then  that  y  decreases  to  y*.  We  will  derive  a  contradiction 

ni 

to  (3.2)  in  either  case. 

Case  1:  If  y  -*  y*  from  below,  then 
i 

Sn  <x  +  y„  >  S (x  +  y*  -  ) 

ni _ ^i_  _ 

Sn  (y  )  -  S(y*-)  * 

ni  ni 


where  S(a  -  )  ■  11m  S(z).  But 

x-*a~ 


S(x  +  y*~) 
S(y*-) 


<  S(x), 


for  otherwise,  3  c  >  0  such  that 


contradicting  the  fact  that  F  is  NBU.  Thus,  for  sufficiently  large  n 


i’ 


S»  <X  +  V) 

~S  (y  j  <  S*x^  +  *0’ 
"i  "I 


contradicting  (3.2). 


Case  2:  y  -»  y  from  above. 

ni 


In  this  case 


V*«  > 


S(x  +  y*) 

■  —  <  S(x) 

S(y  ) 


by  the  right  continuity  of  S  and  the  fact  that  F  is  NBU.  As  in  the 
preceding  case,  this  contradicts  (3.2),  proving  (3.1). 

In  conclusion,  we  have  shown  that  for  every  e  >  0, 

A  _  A 

S(x)  <  11m  S  (x)  <  11m  S  (x)  <  S(x)  +  e 
n  —  n  — 

n  -♦  oo  n  -*«> 

with  probability  one.  Thus, 


Sn(x)  S(x) 


for  all  x  €  (0,«).  ■ 


If  S  is  continuous,  the  uniform  convergence  of  SR  follows  immediately 
from  Theorem  3.1.  However,  the  reliability  applications  of  interest  to  us 
will  typically  involve  survival  functions  with  at  least  one  discontinuity. 
We  therefore  establish  the  following  general  result. 
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atMat  ir  ■> ' 


Theorem  3.2.  Under  the  hypotheses  of  Theorem  3.1, 


supjs  (x)  -  S(x)|  -♦  0 
x 


with  probability  one. 


Proof.  Let  u)  €  fi/7?  .  the  set  of  strong  uniform  convergence  of  S  . 
-  n 

order  to  apply  a  lemma  in  Chung  (1968,  page  124)  we  need 


Sn(x)  -  S (x) 


(3.3) 


on  a  set  of  x  dense  in  (0,®),  which  we  take  to  be  the  set  of  rationals 


Q,  and 


Sn(x-)  -  S(x-) 


(3.4) 


for  every  jump  point  x  of  S  . 


We  have  (3.3)  V  x  €  Q  by  Theorem  3.1.  We  now  establish  (3.4)  for 
a  fixed  jump  point  x  .  Let  e  >  0,  and  choose  6  >  0  such  that  x  -  6  €  Q 


Now  since 


S(x  -  6)  <  S(x")  +  e. 


S  (x-)  <  S  (x  -  6) 
n  n 


(3.5) 


we  have,  by  (3.3)  and  (3.5),  that 


On  the  other  hand, 


lim  S  (x~)  <  S(x-)  +  c, 


Sn(x-)  >  Sn(x-) 


(3.6) 
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so  that 

A 

llm  Sn(x-)  >  S(x-) .  (3.7) 

n  *•  » 

Together,  (3.6)  and  (3.7)  imply  that 

A 

Sn(x-)  -  S(x-). 

By  the  aforementioned  lemma  in  Chung  (1968), 

A 

8up|Sn(x)  -  S(x)|  a,S-:>  0.  ■ 

We  now  examine  the  domain  of  applicability  of  the  consistency  results 
established  here.  It  is  clear  upon  a  moment’s  reflection  that  all  real 
reliability  experiments  have  a  finite  time  horizon.  Thus,  random  sampling 
or  sampling  subject  to  type  II  censoring  from  a  life  distribution  with 
unbounded  support  are  unrealistic  (though  perhaps  still  useful)  mo^£$. 

It  should  certainly  not  be  considered  onerous,  therefore,  to  impose  the 
restriction  of  boundedness  to  the  support  of  F  ,  first,  and  most  importantly, 
because  this  restriction  corresponds  to  reality,  and  secondly,  because  the 
upper  bound  of  the  support  of  F  is  unspecified  and  may  be  as  large  as  a 
particular  application  requires. 

Let  G  be  an  NBU  distribution  on  (0,»).  Suppose  a  sample  X^,...,Xn  is 
taken  from  G,  subject  to  type  I  censoring,  that  is,  subject  to  truncation  5  » 
at  time  T.  Thus,  the  variables  we  observe  are  Y.,...,Yn>  whe*re 

Yt  -  min(Xt,T) 

where  . Xn  G.  Let  F  be  the  distribution  of  the  Y's,  and  let 

S*l-F.  It  is  easy  to  show  that  F  is  NBU.  Moreover,  F  has  compact 


J 
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support,  so  that  Theorem  3.2  implies  the  strong  uniform  consistency  of 

A 

S  as  an  estimator  of  S  .  We  note  that  in  most  problems  of  interest, 
n 

F  has  a  discontinuity  at  T  ,  and  thus  the  generality  of  Theorem  3.2  is 
necessary . 

A 

4.  Convergence  Rates  for  S  ,  It  is  possible  to  study  rates  of  conver¬ 
gence  of  nonparametric  estimators  of  a  distribution  function  in  a  variety 

A 

of  contexts.  We  will  study  in  this  section  the  rate  at  which  converges 
to  S  in  mean  square  as  well  as  the  rate  of  almost  sure  pointwise  conver¬ 
gence  of  Sn  to  S  .  It  is  well  known  that  the  empirical  survival  curve 
converges  to  S  in  the  two  senses  above  at  the  best  possible  rates. 
Specifically,  S  is  mean  square  consistent  with  rate  0(n  *)  and  almost 
surely  pointwise  consistent  with  rate  0(n  (log  log  n)^).  We  establish 
below  a  fundamental  inequality  from  which  optimal  convergence  rates  for 

A 

S  follow.  We  also  obtain  a  rate  result  for  almost  sure  uniform  conver- 
n 

A 

gence  of  Sr  to  S  under  an  additional  regularity  condition. 

Throughout  this  section,  we  assume  that  F  is  an  NBU  distribution 
function  on  (0,®)  with  S*l-F,  and  that  T  »  inf{M|  F(M)  *  1]  is  well 

A 

defined  and  finite.  Let  S  be  as  in  (1.2). 

n 

Lemma  4.1.  Let  x  €  (0,T),  and  let  cr  €  (0,1).  If  Sn(T-x)  >crS(T-x), 
then 

|Sn<*)-S(x)|  <  Dn[crS(f^x)  +  0* 

where 

D  ■  «up  |S(t)-S(s)|. 

0<  *  <• 
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Proof.  Since  S  (x)  >  S  (x} .  we  have 
-  nx  '  -  n 


lsn(x)  -  Sn(x)| 


S  (*)  -S  (x) 
n  n 


r  y)  "1 

■“"[  S  (y)  -  Sn<*>J 


r  S  (x  +  y)  -  S  (x)S  (y) 
n  n  n 

-  QUp  -  i 

y  L 


sn(y) 


J 


S  s"(T^)  sup(Sn(X+y)  -Sn(x)Sn(y». 


The  inequality  follows  from  the  fact  that  Sn  is  non increasing,  and 

S  (T-x)  >  0  by  hypothesis.  Since  S  (T-x)  >orS(T-x),  which  is  positive 
n  n  — 


by  the  definition  of  T  ,  we  have 


|Sn(x)  -Sn(x)[  <  aS (t-x)  *  sup{Sn(x+y)  -S(x+y)  +  S(x+y)  -S(x)S(y) 


+  S(x)S(y)-Sn(x)S(y)  +Sn(x)S(y)-Sn(x)Sn(y)] 


sup|[S  (x+y)-S (x+y)] +  [S(x)-S  (x)]S(y) 


-  aS(T-x)  yt,“  n' 

+  [S(y)  -Sn(y)]Sn(x)| 


since  S(x+y)  -S(x)S(y)  <0  V  x,y. 


—  crS  (T-x)  Dn^ 


by  the  triangle  inequality.  Finally,  we  have 


|Sn(x)-S(x)|  <  |Sn(x)-Sn(x)|  +  |Sn(x)-S(x)| 
3D 


<  V/i.  -T  +  D 

—  ofS  (T_x)  n 


Our  rate  of  convergence  results  for  will  be  obtained  by  applying 
the  well-known  exponential  inequality  due  to  Dvoretzki,  Kiefer  and 
Wolfowitz  (1956),  which  we  state  below: 

Lemma  4.2.  Let  X, 9  •  •  •  ,X  , ...  F,  and  let  F  represent  the  empirical 

—  — —  in  n 

cdf  based  on  fX-,...,X  }.  There  exists  a  universal  constant  c*  such  that 
1  n 

P(/n" Dn  >  X)  <  c*e  , 

where 

Dn  -  sup  |Pn(x) -F(x)| . 

-  ®  <  X  <00 

We  first  study  the  rate  of  mean  square  consistency  of  S^.  The 
following  two  results  supply  the  answer. 

Lenina  4.3.  Let  x  6  (0,T)  and  let  a  6  (0,1).  Then 

slv*>-s<*>|2<  ED„2[^<feo  +  l]2 

+  (l-S(T-x)) 

n(l  -or)2S(T-x) 

Proof.  Let  A  denote  the  event  {Sn(T-x)  >arS(T-x)].  Then 

P(EC)  -  P(S  (T-x)  <  arS(T-x)) 
n 

-  P(S  (T-x)-S(T-x)  <  -  (1 -a)S(T-x)) 
n 

<  P([Sn(T-x)  -  S (T-x)]2  >  (1 -a)2(S(T-x))2) 

S(T  -x)(l  -S(T  -x)) 
n(l-cr)2S(T-x)2 


by  the  Markov  Inequality 


Thus ,  by  Lemma  4.1, 


E|Sn(x)  -S(x)|2  =  J*  |s  (x)  -  S  (x)  |  2  dP  +  J*  I S  (x)  -S(x)|dP 
E  EC 


3  2  2  c 

+ 1)  D  dP  +  P(E  ) 


toS(T-x) 


<ED2r^7f^r+ll  ♦  -1*1031 

-  n  l orS (T-x)  J  „(l -a)2sCI-x) 


We  may  now  establish 

A  2  i 

Theorem  4.1.  E|Sn(x)  -  S(x) |  -cXn"1). 

2  -1 

Proof.  By  Lemma  4.3,  we  need  only  show  that  E(D^  )  =  0(n  ).  But 

nE(Dn2)  =  E((/^  Dn)2) 

-  j“p((A  v2  >  x)dx 

-  J**P(/ n  Dn  >  ,/T)dX 

<  jV.-^dx 


The  rate  of  almost  sure  polntwlse  convergence  Is  contained  in  the 
following  result. 
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A  \ 

Theorem  4,2.  Sn(x)-S(x)  =  £>(n  (log  log  n)  )  almost  surely. 

Proof.  For  any  fixed  a  €  (0,1),  the  inequality  of  Lemma  4.1  holds  with 
probability  one  for  all  n  sufficiently  large.  ® 

We  may  establish  rates  of  uniform  convergence  under  the  additional 
hypothesis  that  S(T-)  >  0. 

Corollary  4.1.  If  S(T-)  >  0,  then 

2  i 

sup  E|s  (x)-S(x)|  »  0(n“  ) 

0<x<T 

and 

sup  [s  (x)-S(x)|  =  0(n”^(log  log  n)S  a.s. 

0<x<n 

Proof:  If  S(T-)  >  0,  we  may  obtain  universal  bounds  in  Lemma  4.1  and 

4.3  by  replacing  S(T-x)  by  S(T-).  M 

5.  Discussion.  We  have  studied  in  this  paper  the  properties  of  an  ad 

A 

hoc  estimator  S  (x)  of  the  survival  function  of  an  NBU  distribution.  We 
nv  7 

a 

have  demonstrated  the  strong  uniform  consistency  of  when  the  underlying 

* 

distribution  has  compact  support,  and  have  verified  that  tends  to  S  at 
the  best  possible  rate  in  the  sense  of  mean  square  convergence  and  almost 
sure  pointwise  convergence.  Thus,  this  paper  presents  an  asymptotically 
optimal  solution  to  the  problem  of  estimating  an  NBU  distribution  with 
compact  support.  An  application  of  particular  interest  is  that  of 
sampling  from  an  NBU  distribution  subject  to  type  I  censoring. 


4 


The  problem  of  estimating  an  NBU  distribution  with  unbounded  support 
remains  open.  This  problem  is  of  theoretical  rather  than  practical 
interest,  since  real  reliability  experiments  have  a  finite  horizon,  even 
though  this  fact  is  ignored  by  most  models.  It  is  nevertheless  of 
interest  to  construct  a  consistent  NBU  sequence  in  the  general  problem, 

A 

and  to  compare  the  behavior  of  such  a  sequence  to  that  of  in  problems 
with  compact  support.  These  challenges  are  left  to  a  future  investigation. 

A  A  A 

The  estimator  S  has  the  properties  that  S  is  NBU  and  S  (x)  >  S  (x) 

n  rr  n  n  —  n 

¥  x.  We. have  therefore  found  the  name  "upper  NBU-izer"  appropriate  in 

A  A 

referring  to  S^.  The  motivation  for  the  definition  of  suggests  other 
possible  NBU-izing  transformations.  An  immediate  candidate  is  the 
transformation 


S  (x)  *  inf  S  (y)S  (x  -  y) , 
0<y<xn  n 


(5.1) 


an  estimator  which  is  also  motivated  by  the  inequality  (1.1).  It  can  be 

A# 

shown  that  is  strongly  uniformly  consistent  for  S  ,  the  survival  function 
of  an  arbitrary  underlying  NBU  distribution!  Emphoria  over  this  result  is 

A# 

mitigated  by  the  fact  that  SR  lacks  a  crucial  property,  namely,  Sn  need 
not  be  NBU.  There  is,  however,  a  "lower  NBU-izer"  which,  while  being 
more  complex,  appears  promising.  We  can  show  that  the  transformation 


To  S(x)  -  inf  n  S(u  ) 
u€C 


where 


C *  -  {u  6  (0,x]  |  2  u  <  x;k*l,2, . . .  }, 


T~nf;inTT|irnniiip^ 


transforms  an  arbitrary  survival  function  into  an  NBU  survival  function. 


Moreover , 


T°  S(x)  <  S (x)  Y  x. 


so  that  S^(x)  *  To  S^(x)  is  indeed  a  lower  NBU-izer.  We  will  report  in 
detail  on  the  properties  of  S^(x)  in  a  forthcoming  paper. 
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